🕷️️ Job Radar • SCRAPING

freelancer.com 🟢 2026-05-13

🔹 Daily CSLB License Data Scraper
👤 Client: 🇺🇸 SHERMAN OAKS, United States Member since 2011-08-24
💰 Price: $146 Average bid
🚩 Problem: Automatically scrape and update daily CSLB contractor records.
📦 Existing: Not specified

Specifications:

[Target] California State License Board website
[Method] Python (requests, BeautifulSoup, Scrapy) or Node with Puppeteer
[UI/UX] Headless browser for dynamic content handling
[Stack] Python: requests, BeautifulSoup, Scrapy; Node: Puppeteer
[Security] Handle rate limiting and avoid captchas
[Format] CSV file overwriting previous data daily

Workflow:

1. Set up a headless browser environment (Puppeteer or Selenium) for dynamic content scraping.
2. Develop a script to navigate the CSLB website, handle pagination, and fill out search forms as needed.
3. Extract all relevant fields: license number, classifications, bonding, personnel, status history, contact info.
4. Implement rate limiting logic to avoid blocking by the site.
5. Write extracted data into a CSV file, overwriting previous content each run.
6. Schedule the script to run daily at 00:00 using cron or equivalent scheduler.